Skip to content

Add data dumps#2047

Open
ArtOfCode- wants to merge 38 commits into
developfrom
art/data-dumps
Open

Add data dumps#2047
ArtOfCode- wants to merge 38 commits into
developfrom
art/data-dumps

Conversation

@ArtOfCode-
Copy link
Copy Markdown
Member

@ArtOfCode- ArtOfCode- commented May 12, 2026

Add data dumps. Weekly export of the entire database minus anything sensitive, uploaded to S3 and made available via a new page linked in the footer. Also adds an option for manually-created dump records, intended for quarterly uploads to Archive.org.

Incorporates #1950 by cherry-pick.

@ArtOfCode- ArtOfCode- requested review from Oaphi and cellio May 14, 2026 10:07
@ArtOfCode- ArtOfCode- changed the title Add some more data dump skeleton Add data dumps May 14, 2026
@ArtOfCode- ArtOfCode- changed the base branch from 0valt/1918/data-dump to develop May 14, 2026 10:10
@ArtOfCode- ArtOfCode- linked an issue May 14, 2026 that may be closed by this pull request
@codecov
Copy link
Copy Markdown

codecov Bot commented May 14, 2026

Codecov Report

❌ Patch coverage is 88.40580% with 8 lines in your changes missing coverage. Please review.
✅ Project coverage is 80.96%. Comparing base (9c10754) to head (7b8f9bf).

Files with missing lines Patch % Lines
app/jobs/data_dump_job.rb 90.90% 5 Missing ⚠️
app/controllers/dumps_controller.rb 60.00% 2 Missing ⚠️
app/models/dump.rb 87.50% 1 Missing ⚠️
Additional details and impacted files
Components Coverage Δ
controllers 76.09% <60.00%> (+<0.01%) ⬆️
helpers 85.32% <100.00%> (+0.01%) ⬆️
jobs 73.20% <90.90%> (+6.32%) ⬆️
models 93.02% <87.50%> (-0.03%) ⬇️
tasks 61.11% <ø> (ø)

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@cellio

This comment was marked as resolved.

@cellio

This comment was marked as resolved.

@ArtOfCode-

This comment was marked as resolved.

@Oaphi Oaphi force-pushed the art/data-dumps branch from cb7bbc5 to 3844eaa Compare May 19, 2026 03:50
@Oaphi Oaphi force-pushed the art/data-dumps branch from 3844eaa to 7b8f9bf Compare May 19, 2026 04:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add a system for regular and/or on-demand data dumps

3 participants